Expressing Implicit Semantic Relations without Supervision

We present an unsupervised learning algorithm that mines large text corpora for patterns that express implicit semantic relations. For a given input word pair Y X : with some unspecified semantic relations, the corresponding output list of patterns m P P , , 1 is ranked according to how well each pattern i P expresses the relations between X and Y . For example, given ostrich = X and bird = Y , the two highest ranking output patterns are “X is the largest Y” and “Y such as the X”. The output patterns are intended to be useful for finding further pairs with the same relations, to support the construction of lexicons, ontologies, and semantic networks. The patterns are sorted by pertinence, where the pertinence of a pattern i P for a word pair Y X : is the expected relational similarity between the given pair and typical pairs for i P . The algorithm is empirically evaluated on two tasks, solving multiple-choice SAT word analogy questions and classifying semantic relations in noun-modifier pairs. On both tasks, the algorithm achieves stateof-the-art results, performing significantly better than several alternative pattern ranking algorithms, based on tf-idf.